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Notation used throughout the flowcharts : 

WCS 

CCS 

(-*. y. z) 

(-r. y) 

(«. v) 

a 

P 

Y 

Subscripts : 

w = WCS 
c = CCS 

t = top 

b = bottom 

a = A/P 
s = Sasittal 



Worid Coordinate System 

C-arm Coordinate System 

Used for 3D coordinates in WCS and the CCS. 

Used for calibrated image coordinates. 

Us^d for real image coordinates. 

Sagittal Angle. 

Transverse Angle. 

Approach Angle. 



Specifies the coordinate system. Only used with 3D 
coodinate systems. 

Specifies a point on the virtual guidewire. 
Specifies to what image the information pertains to. 



[1] J. Canny; t4 A Computational Approach to Edge Detection"; IEEE Transactions on Pattern Analysis Machine 
Intelligence; Vol 8, Nov. 1986, pp. 679-698. 

[2] Mathematics involved in performing the Levenberg-Marquardt optimization method: 



R = 



cosdcosfl 

* 

sindcosfl 
-sinft 



cos<fcsin0sin v - sin^cosy/' 
sinpstn0sin y/ + cosocos if/ 
cosBsiny/ 



cos^sin^cosi^ + sin^siny 
sintfsinGcosuf - cos<psinif/ 
cosdcosy/" 



w c (Xi; a) = 
and 

i/ c (Xi; a) = 



f R n x + R i 2 >' + R n- + r * ) 
R 3l x + R 32 v + R 33 z + t z 

r R 2l x + R 22 y + R 23 z + f y > 
R 3[ x + R 32 y + R 33 z I t z 



s 

% 2 (x; a) = - u Q (x { ; a)) 2 + (v { - v^x- a)) 2 ) 



i=0 



where x, = [x, >\ z], are the 3D coordinates of the fiducials, (a, v) are the 2D coordinates of the center of the fiducials. 
and a = [d>. ft y/, r y , are the six parameters that define a six degree-of-freedom pose. 



[3] Once the fit has been performed I construct the homogeneous transformation matrix that corresponds to the optimized 
parameters (a = [0, ft y/ t r r r ]) as follows: 



REG A = 



costJicosG 
sin<bcos9 
-sin9 
0 



cos(j>sin8sin\y - sind)cos\^ 
sin(bsin8sin\{/ ■+■ cos(pcos\|/ 
cos9sin\|/ 
0 



cos<bsin9cosij/ + sin(bsini|/ 
sin<t>sin9cos\j/ - cosd>sin\y 
cos9cos\y 
0 



px 

py 
i 
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o nee the fit has been performed I contruct the homogeneous transformation matrix that corresponds to the optimized 
parameters (a = [0, 0, y/, t x , t yt rj) as follows: 



REG B = 



cos$cos9 
sin<j>cos9 
-sin9 
0 



cos<t>sin9sin\y - sind)cos\j/ 
sin0sin9sinij/ + cos<j>cos\j/ 
cos9sin\y 
0 



cos6sin9cosv + sin<j>sin\|/ px 

sin<j>sin9cosxj/ - cos<J>sin\y py 

cos9cos\|/ pz 

0 I 



The line of sight is calculated in the following way: 

The line of sight is bound by (0, 0, 0) and (u ct v c ,f) in the CCS. 

Note: (w ct v c ) is the calibrated equivalent of (u, v). See [13] 



LSy wl 
I 



I 



= [ REG A ] 



/ 

I 



0 
0 
0 

1 



- r esl 

L 1 



X&2 
V C s2 

i 



= [ REG A ] 



LSx wl 
LSy wl 
LSz wl 
1 



LSx w2 
LSy w2 
LSz^ 
I 



Sal 

- r cs2 



"2 = / 



V l = 



/ 



Due to the inherent distortion in the fluoroscopic images the line of sight is drawn as a curve image. This is done by 
un-calibrating 50 points on the line bound by (u„ v,) and (a,, v 2 ) as in [15] and drawing a polyline through them. 

Recall that the virtual guidewire is a 3D object bound by (0^, 0 wl , O^J and (0^, 0 wb , -screwlengt^). 
P = (3 + 0. 1 * (# pixels moved by the trackball) 



i 



I J 



= [T l (a, 0, rx, ry, «)] 



0 
0 
0 



wi 



wi 



1 



'Ml 



0 



-screwlength^b 
1 



With ( Vx wl , Vy^, and (Vx^, Vy wb , V^,,) the virtual guidewire's projection is drawn on both the A/P and sagittal 
images using the following equations: 





- r cah 






V 

- v cab 




"•cat 


--tab 




- 1 






r 


— 

- r csb 






>'csb 




r 

*»cst 






- 1 


I - 





= [ REG A ] 



= [ REG S ] 







vy w , 








_ 1 


1 _ 








vy. h 






- 1 


I _ 



X V 

"at = — / = — / 
^-cai — en 

t V 

«« = — / = — / 



*-c;ib *-cab 
"sh = / V sb = / 



APPENDIX 

(Page 3 of 6) 



Due to the distortion in fluoroscopic images the projected guidewire is drawn as a curve. This is done by un- 
calibrating 20 points on the line bound by vj and (u^, v^) as in [15] and drawing a polyline through them on 
the A/P image and similarly for the Sagittal image using vj and (w 5b , v^). 



[8] To draw the virtual guidewire' s projection, two points (0, 0, 0) and (0, 0, -screwlength), in the WCS are transformed 
* so that the top point (0, 0, 0) lies on the line of sight. The virtual guidewire is inidally set to 30mm. The projected 
guidewire is drawn using the following math: 

initially: 
depth = 0.2 
screw/Length = 30mm 
a = 0, £ = 0 

ry f tz) is constrained to lie on the line of sight bound by (Z,£r wl , L5y wl , LSz^ { ) and (LSx^ LSy^ LSz^J, thus 

or = LSx Ml - depth* {LSx„ 2 - LSx^) 
ty = LSy wl - depth*(LSy w2 - LSy wl ) 
tz = LSz wl - depth*{LSz^ 2 - LSAn) 



^ 16; 



Vy 

V; 

1 



1 



= (T'(a. 0. tx, ty, tz)] 













-screwlengtk. b 


_ 1 


r 



in order to draw the projected guidewire on the images, the points (Vx^, Vy^Vz^) and (Vjc wh , Vy^, Vz^J are used in 
conjunction [7]. 

[9] Recall that the virtual guidewire is a 3D object bound by (0 W 0 wt , 0^) and (0 wb , 0 wb , -screw length^,*). 

depth = depth + 0. 1 * (# pixels moved by the trackball) 

tx = LSx^y - depth*(LSx„ 2 - £-S**i) 
ty = LSy wl - depth*(LSy w2 - LSy wl ) 
rz = L5c w , - depth* {LSz^ 2 - LS^,) 



1 T is composed of the following transformations 

T = Trans(fx. ty\ tz) Rot(y, a) Rot(x, /?) 

or 

cosa sinosin/3 

[T (a. P. tx % ty. tz)] = 



0 

-sina 



cosP 
cosasin/3 



sinacos/3 tx 
- sin/3 ty 
cosacos/3 
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V- 



L i 



V- 
I 



= [T l (a. /?, fx, ty, tz)] 



0 

0, 
0 



wt 



wt 



L l 



-screwlength^ 

I 



f 10] Recall thac the virtual guidewire is a 3D object bound by (0^, 0^, O^j and (0 wh , 0 wb , -screwlength„ h ). 
a = a + 0.1 * (# pixels moved by the trackball) 



VV.. 



V- 



L I 



-»»wn 
1 J 



= [T l (a t (3, tx y ty\ tz)] 



0 
0 
0 



0 
0 



-screwiength^ 
1 



f 1 1 ] Recall that the virtual guidewire is a 3D object bound by (0 WI , CU 0^ and (0 wb , 0 wb , -screw lengthy). 















1 


l 



= [T l (a. /3, rx, ry, tz)] 



'wt 



0 
0 



wt 



'wh 



0 



wb 



-screw lengthy 
i 



[12] Given 



[Tool] 2 =[Rot(2, -90)][Rot(y, -90)] 
[Plan] 2 = JRot(y,a)][Rot(x,P)][Tool] 
[Approach] 2 = [R0t(z,y)] 

[FinaiPlan] = 



L P 



and using the following contraints I determine the remaining two vectors that would be complete [FP]. 
Note: The first vector (N) is maintained from the [Plan] since it is the dirll guide axis: 



Contraints: 

1) FP Ax 2 +• FP Av * + FP Al 2 

2) A N - FP A = 0 

3) FP iN • FP A = 0 



= 1 



D = A„ v (Am. ; FP„,-FP^ -AmJ A 



A Nx (FP Nx • A Sy - A Nx * FP Ny ) A^, 



E _ (A^ • FP,-, - FP VT -A Vt ) 
(FP Nx • A Nv - A Ns « FP Nv ) 



: These matrices are ot" the following form: 

Nx Ox Ax 

Ny Oy Ay 
- Nz Oz Az - 



Co. 
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FP A/ = ±VD : + E : + I 
FP AA = D ■ FP A/ 
FP Ay = E - FP Az 

FP () is determined using 

FP () = FP N x FP A 

Hence. 



[FinalPlan] = 




P.N, 




FP A , " 








FP Ay 






Ps, 


FPo, 


FP AI -1 



Since the PUMA 560 robot uses an Euler representation for specifying an orientation, the inverse solution of [FP] is 
determined in the following manner 

Euier representation = Rotfz,<i>) Rot(y, 0) Rot(z, \\f) thus from [i]. 
o = arctanCFP^v, FP^) 

9 = arctan(FP Ax - cos(tf) + FP Ay • sin(0), FP Az ) 

\y = arctan(-FP Nx - sin(0) + FP Sy - cos(0), -FP 0x « sin(0) + FPoy ■ cosfd)) 

Adding a PUMA specific offset to <p y and £ the final position and orientation is established 

Final pose = (<p + 90, 9 - 90, ^ cc, ry, rz) 

[13] The calibrated coordinates (jc, y) of the edge-pixels (w, v) are determined using a quartic polynomial equation as follows: 



x = a n u^v* + a, u 4 v J + a-, u~v 2 + ... + a-,-, uv + a-, 



23 



24 



y = a„ u^v* 1 ■+» a, u 4 v 3 + a 3 u%' 2 + ... + a 23 uv + a ZAt 



the set of parameters a and are previously determined using the image calibration program. 

[14] The center of the fiducial shadow is found by fitting the equation of a circle to the edge-pixels using a pseudo- in verse 
approach: 



r- n + v 



* • * 

• ■ • 

L -<n >'n 1 



2/1 

2k 

r z - h 2 -k 2 



or 

A = BP 

using pseudo inverse 
P = (B T B) ■' B T A 

once P is established the center of the fiducials (h. k) is determined as follows: 
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h=P f 

4 



[ 1 5] The un-calibrated (distorted) coordinates (u, v) corresponds to the calibrated coordinate (x, v) and is determined usins a 
quartic polynomial equation as follows: 



a = a 0 x*\ A + a x jcV + a 2 „rV + ... + a zy xy + a zx 
v = a i} xV + a x xV + a : xV + ... + a 23 xy + a zx 



the set of parameters a and b. are previously determined using a separate calibration program. 



RQbQt Man i pu l ators; — Mathematics. Programming, and Control: Richard P. Paul; The MIT Press, Cambridge, 
Massachusetts and London, England, 1983. 



